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Mathematical C(mtnhution8 to the Theory of Evolution. 



XVI. ON FURTHER METHODS OF DETERMINING CORRELATION. 

By Karl Pearson, F.R.S. 

(I) Introductory. The object of the present paper is to give an account of some 
new methods of determining correlation. It is not suggested that they can with 
advantage replace the old processes, even when the distribution is approximately 
normal; to my mind the methods of determining the correlation ratio and the 
correlation coefficient (17 and r) based on moments and product moments stand fore- 
most for the information they give and its weighable accuracy. At the same time 
there are series which are so short, or cases in which it is desirable to come rapidly 
to an approximate result or data which cannot be presented in a form suitable for 
product-moment working, where other methods are not only reasonable, but necessary. 
To such cases the present new methods apply. I have termed them new methods 
and I think this is legitimate. In the case of the first method, I have not seen any 
hint of it before. In the case of what I term grade methods, Dr Spearman has 
suggested that rank in a series should be the character correlated, but he has not 
taken this rank correlation as merely the stepping stone by which to reach the true 
correlation of the variables as dependent magnitudes, and further in the discussion 
he has given of the subject he has, I believe, given erroneous formulae and made 
quite incorrect statements as to the magnitude of probable errors. 

One word must be said as to the use made of the normal distribution. I have 
used it here as on many other occasions as a means of suggesting fitting relations 
and simple formulae for correlation constants. This does not necessarily mean (i) that 
the constants reached may not have a perfectly definite meaning apart from normal 
distributions, or (ii) that the formulae obtained may not hold for all forms of 
distribution apart from normality. As an illustration of the first case I cite my 
mean square coefficient of contingency*. This is a perfectly general measure of the 
deviation from independent probability in the case of an nxm fold table, but its 

* On the Theory of Contingency, "Drapers' Research Memoirs, Biometric Sei-ies i'* (Dulau <fe Co., 
Soho Square, London. 
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4 KARL PEARSON 

actual form was selected so that it would agree with the coefficient of correlation in 
the case of indefinitely fine grouping and normal distribution. As an illustration 
of my second point I take the formulae given by me for the influence of selection on 
variation and correlation*. These formulae were originally proved for normal dis- 
tributions, but for a number of years past the proofs given in my lectures have 
been perfectly general, depending only on a more comprehensive definition of what 
we are to understand as correlation in the case of a complex of variables. 
These points will be considered in the present treatment of correlation. 

(2) On Difference Methods of finding the Coefficient of Correlation. 

Let X and y be two correlated variables, each measured fi'om their means m^ and 
mj respectively. Then if i; = a5 — y, and 0-3., o-y, o-^ denote the three standard deviations 

<Tv = o-/ + <^y - 2r^o-^o-y 
and r^ = (o-,^ + <-o-,0/(2a-,a-,) (i). 

This method of finding r^ has long been in use as an alternative method to the 
product-moment method f. 

It involves finding the mean-square difference of the values of the pairs of 
correlated characters. It is possible, however, to find r^ from about one half 
these differences, if we assume the distribution to be normal. 

More generally I proceed as follows. Suppose the fimction mx — ny formed, where 
m and n are at present indeterminate positive constants, and let the positive values 
only of this expression be taken and divided by the total ficequency N^ Then it will 
be possible to determine r fi:om this result. 

If z be the ordinate of the surface, then : 

z = . e "^i-^W ^*<^v ^vl (u) 

27ro-,o-3N/l — r* 

and we have the above result expressed analytically: 

S(mx-nv) 1 I ff _x_i_ |^f!-??:^+?l-\ 

^ ^ — ^ = . I Umx-ny) e ^ i-^*\<r«* or^o-y (ryVdydx ...(iii). 

The limits to y in order that mx — ny pay be positive are y = — 00 to mx/n, and 
the limits of x will then be a: = 00 to — 00 . 

Put y'^y/o', xf = x/a',, 

then 

— ^^ 
S{mx- ny) _ 1 1 r+« rna, ^x 1 (^_2ryy+y«) 

♦ Phil, Tram. A, Vol. 200, pp. 1—66. 

t For example, Phil Trans, A, Vol. 198, p. 242, and often elsewhere. 
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Write y" = ^^'a/_«', 

and we have : 

The order of integration can now be changed and we have : 

^^^T^' = t jB?\i re-'"-' /:: .-* '^"-^ d^iv. 

where if c = m(Tj{na-^, 

l^_ l-2 re(l- e) -r'e' 1 l-2re + e' 

a'~(l-2rc + c»)(l-r^)' J8'~ l-r" ' 

y = e(l-r)/(l-2r€ + c'). 
But the integral with regard to a/ is Jiir /8, and 



/, 







TT /S (wa; - ny) 1 no-. , — „ 

Hence : "Sv— = 2^ TTT^^ ^^2^ ^a". 

Or, for the positive summation 

S{mx -ny) _ nV^' (1 - r^) VnV,' - 2rmn<T^(T^ + w'(t7 ,. x 

N "" ^/2ir nV,' — 2r77io-, (/lo-, — mo",) — r'mVi' 

This general value does not appear to be likely to be of much service. If we take 
m = n = 1, we obtain the result of simply summing the positive differences of paired 
variates. It is : 

J^ x/27ro-,«-2r(r, (0^,-0^0 -^<^i' ^ 

(v) leads to an equation of the 5 th order to find r and again does not appear to 
be likely to be of any service. The variates must be reduced to a common unit before 
they are handled if we are to make (iv) workable. Such a unit is the standard 
deviation. 

If we write m= — n = — , we have at once : 
0-, 0-, 



Thus we find : r= i -^ j-A2^_^'^ > 



N 'V' TT 

3 

(vi). 



6 KARL PEARSON 

(vi) is an extremely neat formula and might be taken as the definition of a quantity 
measuring correlation. But the actual determination of correlation in this way, 
i.e. the reduction of each variate to a deviation from its mean measured in terms 
of its S.D, as unit, would probably be as troublesome as using the product-moment 
method. 

One special case occurs, however, in which the above formula may possibly be of 
good service. Suppose the two variates have the same mean =m and the same 
s. D. = 0-, then : 

n{S{x-^!/)Y_ {S{m + x-^m + !/)Y . ... 

NW " NW ^ '' 

Or, the coeflBcient of correlation is the result of subtracting from unity tt times the 
square of the mean sum of the positive differences of paired variates divided by their 
common standard deviation. 

For cases in which both variates are the same, brothers, cousins of the same sex, 
homotypes, etc., and especially for some cases of short series, the method may be 
of value. 

nivstration I. Resemblance of Lerigth of Little Finger in Mode Cousins. I take 
a short series of 68 male pairs of cousins. The average value of the length measured 
on the little finger was 51*02 mm. and its standard deviation 2721 mm. There were 
33 positive differences of finger length giving S{x--y) = 87 '6 mm. Hence we had : 

(87-6/68)^ ^^^ 

Found by the product-moment method the answer was "287 ; the difference is 
well within the probable error of the latter value. The process of taking differences 
and summing was considerably shorter than finding a product moment. 

Illustration 11. Assortative Mating in the case of Paramecium. • I take 
Dr Pearl's Table AA3 from Vol. v. p. 295 of Biometrika for the lengths of 
conjugating Paramecia. 

I choose this purposely because there was no difficulty above about the male 
cousins ; there were only two equalities, the actual measurements of each individual 
being recorded. But in an ordinary correlation table owing to the method of grouping 
there will be a very considerable number of ties, and the problem arises how are they 
to be distributed. Clearly one half of them will be excesses and one half defects, 
if we suppose the odds against an actual tie in measuring to any degree of accuracy 
to be very great. Hence we may say that half the diagonal total is to be treated as 
in excess. But at what portion of the base unit are we to set the pair apart ? If the 
frequency was uniformly distributed over the diagonal cells, we should take the average 
interval between a pair to be ^ the base unit. But the material is almost always 
clustered inside the cell, and clearly ^ is too much. The actual value to be taken would 
depend upon the value of the correlation and the size of the base unit. In fact we 
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can only take a rough approximation. I suggest that J will be found to work 
fitirly well. Accordingly we take ^ of the contents of the diagonal cells, multiplied 
by the base unit. The whole process may now be written as follows : 
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o-=19-ll2», S(x-y) 



16-3 
85 
76 
54 
16 
20 
12 
279-3 X 10 



The value obtained by the product-moment method is '588 ± '022. 
The correlation Table is as follows : 

Length of First ConjuganL 
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♦ Pearl, loc. cit. p. 226, Table II. 
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we proceed thus : Read each column down to and including the diagonal cell, and 
place the total under the corresponding differences in the previous scheme. For 
example, take the sixth column ; 1, 0, 1, 7, 25, 22, are the corresponding frequencies, 
and these numbers will be found, sloping from the colunm marked 5, i.e. difference 
5x10, diagonally across the scheme. In this manner the columns of the table can be 
disposed in the scheme at once. The scheme columns are then added up and 
multiplied by the difference at the top, and, if multiplied again by the base unit, 
in this case 10, the total gives 5(a; — y). The whole can be done with very great 
rapidity, and the correlation found in about 10 minutes if o- be known. 
As other comparisons I give the homotypic results : 

Monmouthshire Ashes (65,000) 
Papaver Ehoeas (Quantocks) (19,790) 
Ditto (Chilteras' Base) (25,160) 

These results show that there exists quite a reasonable amount of agreement between 
the two methods, and the difference method is much the shorter when the table 
contains thousands of observations as in these cases. At the same time too much 
reliance must not be placed upon the difference method, not only because it assumes 
normality of distribution but because it involves a somewhat rough method of 
approximation in the case of the diagonal cell. 

One forther point may be noted. Suppose that rank in a series was a true 
character which could be dealt with by a difference formula like the above then r the 
correlation of the ranks would be given by 

Now for such ranks cr^^^{N^—l), therefore 

*^ ^ N^N'-l) ^'^^• 

Dr Spearman has introduced a quantity R which he terms a "correlational 
coefficient*" and which he defines without any special justification by: 



We should thus have : 



P_ S(x-y) > 

^-1 ^{N'-l) ^'''^• 



'-^-^^i'-^y «' 



which would give approximately : r = 2R — R\ 

* Journal of PsycM^ygy^ Vol. ii. p. 96. 
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This is, of course, not true, for the distribution of ranks is not normal ; the exact 
formula will be given later ; but it suflSces to indicate that the actual distribution 
assumed for x and y will much influence the relation between r and R. Dr Spearman 
from trial, gives the empirical formula 

M. 



-sin I if) 



which is also incorrect. But the above relation shows that we are not d priori 
compelled to suppose that r merely changes its sign, not its numerical value 
when R changes sign. 

(3) On the Correlation of Grades. A method of representing frequency has 
been introduced by Francis Galton in which the extent of variation of a character is 
expressed by the position of the individual bearing this character in the population. 
This method was originally spoken of as that of percentiles but more recently as that 
of grades. A fundamental feature of the method is that the grade is looked upon as 
an index to the variate, it is not considered as in itself significant, or treated as an 
independent character of the individual. In order, however, to pass from the grade 
to the variate it is absolutely necessary to make some hypothesis as to the nature of 
the distribution. The hypothesis hitherto made is that the frequency follows, at 
least fairly closely, the normal or Gaussian law. On this assumption, tables of the 
probability integral enable us to pass at once from the grade to the magnitude of the 
variate, and vice versd. Quite recently, however, Dr Spearman has proposed that 
rank in a population for any variate should be considered as in itself the quantitative 
measure of the character, and he proceeds to correlate ranks as if they were quanti- 
tative measures of character, without any reference to the true value of the variate. 
This seems to me a retrograde step ; hitherto we have dealt with grade or rank 
(I will distinguish between them presently) as an index to the variate, and to make 
rank into a unit itself cannot fail, I believe, to lead to grave misconception. Between 
mediocrities the unit of rank treated as a measure^ of a variate is practically zero, 
between extreme individuals, it is very large indeed. To state that two individuals 
differ by m ranks carries no meaning at all unless we add, (i) the size of the population 
dealt with, (ii) the position in the population of one or both individuals, and (iii) the 
nature of the frequency distribution which governs the population. I cannot therefore 
look upon the correlation of ranks as conveying any real idea of the correlation of 
variates, unless we have a means of passing from the correlation of ranks to the value 
of the correlation of the variates, i.e. the correlation of ranks can only be treated as a 
step subsidiary to determining the true variate correlation. 

The correlation between variates can be made to change widely by preserving 
the same system of ranks, but by altering the nature of the frequency distribution. 
Thus consider the system : 
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Vimates 



X 


-2 


-1 


+ 1 


+ 2 


y 


-2 


-1 


+ 1 


+ 2 



Ranks 



1 


3 


3 


4 


I 


2 


3 


4 



The correlation of variates is perfect and the correlation of ranks is also perfect. But 
we may also have : 



Variates 



X 


-2 


-1-9 


+ 1-9 


+ 2 


y 


-2 


-01 


+ 01 


+ 2 



Ranks 



1 
1 


2 


3 


4 
4 


2 


3 



The correlation of variates is now 72, but the correlation of ranks remains perfect 
and would indicate nothing of this great difference. I think that it is safe to assert 
that until some assumption is made, at least as to the approximate nature of the 
distribution, we cannot hope to avoid misconceptions if we use the method of ranks 
without reference to the rank as index of the variate. 

In such a case there can hardly be a doubt that the best method is first to 
consider to what results normal distribution will lead us, and secondly if the formulae 
found turn out to be of a simple character to adopt these as the basis by definition of 
the variate correlation constant as found from a method of ranks. This will be 
the course adopted in the present memoir. 

(4) Let there be a population of N members and let these be under investigation 
for two correlated characters, means m^, m„ standard deviations o-j, o-„ correlation r. 
I shall suppose normality of distribution. Let mj + a:, m, + y be the deviations of the 
two characters in any individual. Then I term : 



VZTTO-i j 



<r^ dx 



\ e ^rdy 
Jo 



i7r<r- 



.(xii), 



the X' and y-grades of the variates for the individual. It will be obvious that g^ and 
g^ are mathematical functions of the variates and that accordingly the correlation 
between them determines that between x and y, or vice versd. 

Obviously gr, and g^ can be found from tables of the probability integral as soon as 
X and y, the deviates, are known. 

I term rank the actual position in order of an individual with regard to any 
variate in a given series obtained by measurement or observation. If v^ be the 
'rank' of an individual for a given character this signifies that in the observed 
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population there are I'l — i individuals with character greater than x. If therefore we 
were to identify this with the grade we should have 

fl^i = ^i-i (xiii), 

or g^ would always differ from a whole number by '5. This, of course, it does not, 
and the whole problem of working with ranks really centres on the degree of 
approximation which is made when we proceed from ranks to grades by the relation 
(xiii). A grade determined from a rank and not from a variate we may term a 
spurious grade; actually the real grade often differs by several units from the spurious 
grade, and the practical problem is: To what extent does this vitiate the use of ranks 
as a subsidiary stage to the determination of variate-correlation ? 

I shall first proceed to find the mean and standard deviation of a true grade ; 
(xii) shows us at once that gi=g% = ^N is the mean value of the grade. 

The frequency of a given variate lying between x and x + Sx 

= i=—e ^i dx^dg^. 
But the frequency of the variate must also be the frequency of its grade, or : 

Hence we have: ^g^'=^^0,^^^^^^ (^i^)- 

Now whereas our grades are a continuous series, the spurious grades or ranks are 
discontinuous and at intervals ^=1. (xiii) shows us at once that 

i^i = i^s = ^i + i = i(^+l). 

Further o-,X + t^M 

the latter corresponding to the Sheppard's correction by which we pass from raw to 

adjusted moments. 

Thus we have : o-,; = o-,/ =-^{N'-l)] 

\ (xv), 

i^. = i^, = i(iV^+l) J 

(xv) must be used whenever we are dealing with ranks or spurious grades. 

Writing ii=gi-'g, and 14=5^3 — gf,, I now turn to the determination of the product 
moment of the grades. Let us put : 



2J = : 



t— j===e 2(l-r»)W ^i<r,^<r,V (xvi), 



then: Pg^ff,- \ \i^zdxdy 

J -00 J -00 

gives the product moment of the grades. 

2—2 
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Differentiate jpg^g^ with regard to r which is not contained in either i\ or i, ; we 
have: 



'^-\::\:j-t'^y 



But I have elsewhere* shown that : 

dz (Pz 



— o-rO-. 



.(xvii). 



dr ' *dxdy 

Accordingly : %^ = <^.<^./^" \\l »>^. ^y^'^^V' 

Integrating twice by parts and noting that the part between limits vanishes in 
both cases, we have : 

Substituting for dijdx and dijdy and writing x^afa-i y = j/(rtf we find : 
dr 4Wl-r'J-«J-« 



A'' 1 N"' 



> 



2^71-*^ //2-j-'V r* 2W4-r'' 



' // 2-?-' Y r' 



Now if pu be the correlation of grades, we have : 

- _ P,,,, and ^' - — — ^^ 

Thus remembering (xiv) 

dp,a _ 6 1 

dr ""ir74 — r** 

or, /)„ = - sin "' ^ r + constant. 

TT 

Now pu and r must vanish together, hence the constant is zero. Accordingly we 
have : 



r = 2 sin 



^/>i.) (xvui). 



This remarkably simple formula enables us to determine the value of the true 
variate correlation from a correlation of grades on the assumption of the normal law ; 
or if grades may be replaced by ranks, a knowledge of the correlation of ranks will 
give us the correlation of the actual variates behind the order exhibited in the 
ranking. The important idea embodied in the above formula is the basis of the 
present memoir, and is as far as I am aware wholly new. 

♦ PhU. Trans. A. Vol. 195, p. 25. 



/>1^- 
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It remains for us to consider methods of finding the rank or grade correlation and 
the probable error of such methods. 

(5) A convenient method of finding the grade correlation is that of formula (i), 
p. 4, we have at once : 

2criO-, 

Or. ,.= i_?Stezft): (,;,), 

if we use true grades, 

^^i' "^""" iV(V'-i) •. ^'''')' 

if we use ranks v^ and v^. 

If we use ranks the discovery of S{vi — v^y or the sum of the squares of the 
diflTerences of ranks forms a very easy process of determining /)„, due regard being 
paid to certain points to be dealt with in the illustrations below. Then (xviii) will 
give the variate correlation. 

The probable error of /)„ and of r found in this way will be given in another 
section. 

Since the determination of /)„ by (xx) is algebraically identical with finding p^ by 
the product moment, and such product moment gives the least probable error in the 
determination of a correlation coefficient, there must be some fallacy in a statement 
which has been propounded among the psychologists that a difference method of 
determining the correlation will give />!, with about f of the probable error of the 
product moment method. This fallacy will be considered later. 

Meanwhile it is of interest to show that the probable error* of 

pit = {S {Pi Vt)ln - vJ]l{o',^ cr^,) 
is of the form : 

•67449 
P.E. =7==- (l-c,/),,» + c,p„* + c«/)„*+ ...) 
vn— 1 

where c^yC^,c^,**. are undetermined constants. Or, the probable error of /)„ for /)i, = 0, 
or for uncorrelated ranks is 

•67449/Vn-l, 

i.e. is absolutely identical with probable error of a coefficient of correlation of any two 
uncorrelated variables, and is not as asserted much smaller. 

Since for ranks cr^, and o-^, are constant, we have f to find the value of 



«'=s{^-{i(«+i)}-}'. 



v^ and I/, being independent, in order to reach the squared standard deviation of 
/>!» for /),3 = 0. 

* n is here put for N as more convenient for the algebraic work which follows 
t I owe the following proof to the kindness of my friend " Student." 
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There being no correlation, n ! arrangements of this product occur with equal 
frequency. Hence 

Next any v^v^ occurs in (n— 1)1 of the arrangements, for if v^ be paired with i/„ 
the remaining n — 1 pairs may be arranged in (n — l) 1 ways. Thus 

S{2(^js(..)/»} = 2(n-,),('i±-7ifc^ 

Further: t (^^^J = 'Z^,{S{u,W) + 2S{p,v,Wu:)}, 

where i//, v/ are different from v^, v,. 

Now VjVj* occurs in (n — 1) ! arrangements ; hence 

, (gfey))=i^.i>-'.ws(...-)=fe:;il' C<°^'f''^") - 

Next v^vji^^v^ occurs in (n — 2) ! arrangements. 
Thus: .(?«fc^))=i(!i^'s(w.V) 

= <^^>^' s (-.I..) {s (->.') - .., s (-.') - ^, X M + -.v.}, 

lb 

where v/ and »',' may now take all values. 
Thus: 

^ (n-2)! r / n(n+l) Y _ g / n(n+l) Y n(n + l)(2w+l) _^ / n (?i+ 1) (2n + l) Y'l 

= ^V.!^'' ('i + 1 )' i9«' + 3ri' - 8»i - 4}. 
144 
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Collecting the various parts we find : 

«■- <"-'>' <''^;>'<^"^'>V <^'(n+l)-(9n-+3n--8„-4) 

or, after reducing, u* = -^ J^ ~ ^ . 

Therefore the mean value of u* is ^-~ ^ . 

144 

Now the probable error of p,j, for uncorrelated ranks : 

= -67449t//<r,^<r,,. 

= 'G7U9/Jn^ (xxi). 

It thus follows that if the value of pi, be not two or three times the expression 
(xxi), there is no significant correlation of ranks, and therefore no significant corre- 
lation of the corresponding variates. 

(6) On the Difference Method of finding the Correlation of Grades. 

Exactly as in the first section of this paper we may seek the correlation of grades 
by means of the sum S{g^—g^ of all their positive differences. This is slightly 
shorter than finding S{g^—g^^, but only very slightly so, and it may be doubted 
whether the increased rapidity of working at all compensates for the decreased 
accuracy of the process. Still the result is interesting and throws considerable light 
on one or two allied points. 

Let G^S^g^—g^y where the sum S is for all a:-grades which are greater than 
corresponding y-grades. 

Let us put a: = 0-1 a/, y^c^yfy and write 



^•=/>" 



^'dv. 



1 ^ 1 ^ 

Z — 7== Z. 

2ir -J 1 — r* a-iO-t 



Then: G = -j=l ^\j^j^-j^)zdydx 
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dG 
dr 






Put y' = a/ — y"; then after rearranging: 
rf(? N' /■+» f* f,, , / , 2 + r ,,\ 2(l+r) J 

X e " Mr+^ r " 3+^ ^') "^ (i-'-)(3+r) n tZy (ia/. 
The order of integration can now be transposed and if X be written for 

^ 2 + r „ 

the limits of X will also be — 00 to + « . Thus : 

<^r (27r)*(l-r')SJo j-«r 3 + r ^ f ^ 

But if c have any value : 

re-i<^^'XdX = 0, and f e-i'^^'(iJS: = y2^i. 

J -00 J -00 ^ 

Hence : 

rfr (1-7^)1(217) 3 + r V3 + rjo^ ^ 

^ iV' 1 2(l+r)S(l-r)(3 + r) 
2w (l-r»)8 (3 + r)i 2 

i\^' 1 N' 1 



2ir n/( 1 - r) (3 + r) 2jr V4 - ( 1+ rf ' 

Hence integrating : 

n 4. 4. ,^' .,1 + r 

Cr = constant + -r~ cos ' —;r— . 
2n- 2 

But when r=l, G must be zero ; therefore the constant is zero, or inverting ; 

r = 2 co8 27r-jr^,— 1. 
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Or, finally*: r = 2 cos 27r ^-^-^7^)- 1 (xxii). 

This gives us the correlation of two variates from the corresponding grades by a 
difference method. 

If r be zero, we must have 2ir ^^^'^ equal to 60*' = ir/3, or S{g^-g^)^\N^ 

when there is no correlation of variates. This is easily proved directed, for in this 
case: 

1 r^' r^* 
^n]o Jo ^^"""^y^^^y^^^ 

NJo 2^' 6 • 
For ranks the corresponding expression to be used is \ (-V*— l), or we have : 

r = 2cos2ir^^^'^)-l (xxiii). 

As before the truth of (xxii) depends on the approximation to normal correlation. 

If we combine (xx), (xviii) and (xxiii) we have the relation between S(i'i — v,)* and 
S (i/j — I/,) which holds in the case of normal correlation. 

Writing i2= l -6'(i',- v,)/^(i\^*- 1), we have : 

r = 2sin-pi, = 2co8- (1— i?) — 1 (xxiv). 

Dr Spearman givesf the relation : 

p„ = sin^|i2j (xxv) 

(he neither connects p^, nor -R, with r) as apparently an empirical relationship and 
speaks of it as " all that could be desired." It is clearly incompatible with normal 

* The relationship of (xxii) to (vii) is easily seen if we expand the cosine as far as the square of the 
angle. We have 



r 



= l-%\Si,,-9.)Y^l-YJ^^^'=l - 10472 -{^j^;;/')r 



(vii) would have given us 1 instead of the factor 1*0472. Thus when there is high correlation, or S{gi —g^ 
is small, we see that the difference method with grades leads us to nearly the same result, as the assumption 
that the grades themselves form a normal distribution. This suggests that Spearman would have got 

much better results for his "footrule** for measuring correlation had he taken i? = 1 - 3 .^a j ( ~ Ij — ^" ) 

instead of 1 ~^ , *' ; for this value, i.e. 1 - ( — iz^ ) in his notation, would have been almost the true 

variate correlation r. 

t Journal of Psychology, Vol. n. p. 102, 

3 
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correlation, which at any rate is a fairly good guide for general relations of this sort 
in the theory of frequency. Table I. gives the values of r and R for each '05 for p^ . 
Table 11. gives the values of r and p„ for each '05 of i2, and in the last column the 
value of /)„ which would arise if (xxv) were correct. 



Table I. Correlation of Variates from Mean Square 
Difference of Grades. 



I ft. 


r 


H 


ft] 


r 


R 


i -00 


•000 


•000 


•50 


•518 


•323 


■05 


•052 


•029 


•55 


•368 


•361 


•10 


•105 


•059 


•60 


•618 


•400 


•15 


•157 


•089 


•65 


•668 


•442 


; -20 


•209 


•120 


•70 


•717 


•4«6 


' -23 


•261 


•152 


•75 


•765 


•533 


, -30 


•313 


•184 


•80 


•813 


•684 


\ -35 


•364 


•217 


•85 


•861 


•644 


•40 


•416 


•251 


•90 


•908 


•709 


1 •45 


•467 


•286 


•95 


•954 


•796 


•50 


•518 


•323 


1^00 


1^000 


1^000 



Table II. Correlation of Variates from Difference of Grades. 



R t 


r 


P,i 


rixv) 1 


It 


r 


Pw 


(XXV) 


•00 


•000 


•000 


•000 1 


•50 


•732 


•716 


•707 


•05 


•089 


•085 


•078 1 


•55 


•782 


•767 


•760 


•10 


•176 


•168 


•156 


•60 


•827 


•814 


•809 


•15 


•259 


•248 


•233 


•65 


•867 


•856 


•853 


•20 


•338 


•324 


•309 


•70 


•902 


•894 


•891 


•25 


•414 


•398 


•383 


•75 


•932 


•926 


•924 


•30 


•486 


•469 


•454 


•80 


•956 


•952 


•951 


•35 


•554 


•536 


•522 


•85 


•975 


•973 


•972 


•40 


•618 


•600 


•587 1 


•90 


•989 


•988 


•988 


•45 


•677 


•660 


•649 


•95 


•997 


•997 


•997 


•50 

1 


•732 


•716 


•707 


100 


1-000 


lOOO 


1000 



Now these Tables bring out several interesting facts. The first is the remai'kable 
closeness between the correlation of the grades and the true correlation of the 
variates, if we suppose the system normal. The maximiun difference as shown by 
Table I. is '018 and actually the maximum of r — p^ occurs when pu = '5756 and is 
then '01 80. Thus, the difference will often be of the order of the probable error. 
The formula (xviii) is so simple, that we can always deduce the variate correlation at 
once from the grade correlation. I propose to define r as given by (xviii) as the 
grade-variate correlation. Whenever the system is normal, or approximately normal, 
this will agree with the true variate correlation .closely. Next Table I. shows us that 
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equal differences of /)„ give almost equal differences of r, i.e. the differences only 
range from "052 to '046 of r for differences of '050 of />„• On the other hand the 
differences of r for equal differences '050 of R vary from '089 to '003, or second 
differences become of importance. Clearly for high values of i2, r will be found much 
more closely than for low valuea 

If Ei be the error in r due to an error E^^ in />„, and Ey' be the error due to an 
error E^^ in i2, we have : 

^/ = |cos|/)„x^^., 

^/' = |'sin|(l-i2)x^^ 

if we use differentials. For the special case of p„ = -R = 0, we have seen that the 
probable error of pia=*67449/N/n — 1 ; it will be seen later that the probable error of 
R is •4266/>/n— 1 nearly, and if E^ be the probable error of r = 0, as found in the 
ordinary product moment way, we have : 

1? i?f i?n '6745 TT -6745 2^73 "4266 
n/h-I 3>/n-l 3 2 Vn-1 

•6745 -7063 7738 , .v 

::-T— : -1=^ : -/- — (xxvi). 

V n — 1 V n — 1 V 71 — 1 

Thus we see that, contrary to what has been asserted, the accuracy of the new 
methods — when they are measured by the determination of the true correlation — 
are less than the old product moment method. In particular it requires about 
30 per cent, more observations by the R method to obtain v with the same degree of 
certainty, when r = 0. 

At present we do not know the R factor term in Ej^y when R differs from zero, 
and accordingly cannot test E^y EJ and EJ' at other values of R or p^, but I have 
little doubt of the general truth of the result that E^ is at all values as well as for 
r = 0, sensibly less than E/ and still less than E/\ 

(7) Remarks on the Probable Error of R. 

The probable error of a quantity in which the limits of the summation vary as we 
make random variations in the constants is always a troublesome matter, and I have 
not yet succeeded in evaluating the probable error of S{gi'-g^) when gi>gf for any 
value of r. 

Spearman has investigated the probable error of the corresponding expression for 
ranks, 5(vi — v,), wheii there is no correlation between the ranks. He finds that for 
n observations the probable error of R may be taken as 'iS/Jn, and from this result 
he has drawn rather sweeping conclusions as that : " twenty cases treated in one of 
the ways described furnish as much certitude as 180 in another more usual way" ; or 
that : ** a probable error may at present be admitted without much hesitation up to 

3—2 
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0*05 ; so that by adopting the method of calculation recommended, two to three 
dozen subjects would be sufficient for most purposes*." Now these statements seem 
to me not without grave danger, and accordingly it is well to see where the error has 
crept in. 

Spearman gives the value '4266/^71, but it should be •4266/N/n — If, and accord- 
ingly since we have seen that the probable error of p^ for p„ = 0, is '6745 /\/n— 1, the 
probable error of -R would only be about | of the probable error of p,2, and upon this 
Spearman's statements are based. 

Now the probable error of any quantity is conventionally '67449 x standard 
deviation/Vn— 1, and accordingly for the same number of observations the probable 
error is less when the standard deviation is less. But there would be no meaning in 
asserting that the mean of 20 metacarpal bones could be found with much more exacti- 
tude than the mean of 20 humeri, because the latter being a larger bone had a greater 
variability. We must either measure the same quantity by different processes, or 
else be at any rate certain that our quantities are alike in character and function 
before we compare their probable errors. The probable error of ^x is certainly less 
than that of x. Now p„ is a true correlation and ranges from + 1 through to — 1 
with a symmetrical distribution about 0, if we take the case of a random distribution 
of ranks. The quantity R presents nothing of this nature at all ; random distribution 
of ranks does not give a symmetrical distribution for -R, its range is not from + 1 
to — 1, and there are certain values it can never take. In order to bring out these 
points I take the following table for R negative. 

Table III. Negative Correlation of Variates from Difference of Grades. 



B 


r 


Pa 


-05 


- 092 


- -088 


-10 


- 187 


- •ITS 


-15 


- ^283 


- -271 


-•20 


- -382 


- 367 


-•25 


- ^482 


- 465 


-•30 


- ^584 


- 566 


-•35 


^ •687 


- ^670 


-•40 


- 791 


- ^777 


-•45 


- 895 


- •sse 


-•50 

1 ' 


-1000 


-1000 



N.B. It will be observed that when E is 
negative, the true variate correlation is almost 
double the magnitude of /?, while if i? be 
positive (Table 11.) r is larger than B but not 
to this exaggerated extent. It will be clear 
that no estimate of the real correlation can be 
based on i?, if it does not allow for this ex- 
aggeration. 



* American JoumcU of Psychology , Vol. xv. pp. 100, 101. For the proof of the probable error cited 
see ; British Journal of Psychology^ Vol. ii. pp. 105-8. 

t Spearman's result at bottom of p. 108 may be written —.-— nj ^ ^- ,- , or neglecting terms in -, 
not ~ as he does^ this gives •4266/\/n— 1 as we should anticipate. 
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Thus we see that while r and p^ run from —0*0 to — I'O, R only runs from —0*0 
to --50. 

In order to obtain his probable error for R Spearman takes every random arrange- 
ment of ranks v^ and v^ for which Vj is greater than v^. He has neglected to observe 
that when he does this his R will become negative, but that it will not range 
from — 10 to + 1*0. For example, I take the following system of ranks for (2m + 1) 
individuals : 



vi = 



V2= , 



2w+ 1 



2m 2//1-1 



•2m - 9 



2m + 1 



This gives : S{v,- v.)' = 2 {(2m)^ + (2//t - 2)'' + (2m - 4)H . . . + 2^} 

= 8m(m+l)(2m+l)/6, 

_ 65^(i/,-i/,)^_ 8m( m+l)(2m + l) 

•• f"''^^ NiN'^l)"^ (2m+l)((2m+ 1)^-1)"" ^' 

But S(i'i-i/j) = 2 + 4 + .., + (2y/i-4) + (2??z-2) + 2m = m(//i+l). 

Therefore • i2 = 1 - — ^''^ " ''^^ - 1 - -^('^±D- ^ - -5 
ineretore. /t-i ^,_^ -i (2m+ 1)^-1" ^ 



..(xxvii). 



Accordingly when the correlation is negative and perfect, the number of observations 
being odd, R will never take the value — 1, but no greater value than — 5 ; whereas 
if we reckon our second ranks in the negative direction R will equal + 1. 

Here the Spearman formula (xxv) leads to the absurd result p,j = — 1 /J2, instead 
of —1. On the other hand my formulae (xxiv) for pu=— 1 and i2=— -5 give 
absolutely the correct value r = — 1 for the variate correlation. 

Again take N even = 2m and consider the system : 



"1 = 


1 

1 2 

1 


3 ' 4 

1 


1 


2n 


V2 = 


2m 2m - 1 


2/H-2 2wi-3 


• 


1 



We find : S{y,- v,)' = 2 {{2m - 1 )» + (2»i - 3)» + (2m - 5)* + . . . + 1'} 

2m 



= -5-(4m=-l), 



and this gives p„= 1 - 2;H(4m'-l) = " ^• 

Again : S{v,-v,)-l-\-S + 5 + ... + (2m- 5) + {2m - 3) + (2m- 1) 

= «r. 
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Hence: 




For: 


iNr=4, iJ=--600; A'=10, i?=-'515, 




iV^=20, /?=-»504; A^=100, i?=--500. 



Or, again, the limit — '5 is rapidly reached as the number of observations 
increases. In fact solely for the simple case of two observations is it possible for R 
to reach —1. 

If it be objected to (xxiv) that it would now give for values of R, greater than 
- '5 values of the variate correlation greater than — 1 (= — 1*09 at a maximum for 
iV=4), this is overlooking the point that (xxiv) is deduced from (xxii) by replacing 
true grades by spurious grades or ranks, and that if we retain (xxii) then 

and r = — 1 as it should do. 

We have now reached I think the basis of Spearman's apparent paradox. While 
the variation of the true rank correlation p„ lies between + 1 and — 1 and has 
•67449/>/iV— 1 for its probable error, the value of R only ranges between +1 
and — '5, and may well have a less value for its probable error. 

Now Spearman tells us that large negative values of his R should be avoided*. 
There is no necessity whatever for avoiding them if we are seeking the variate 
correlation by the formula given in this memoir. But if we are seeking the probable 
error of a zero quantity, which may vary on either side of zero (and in this case the 
variation is not symmetrical about zero), we cannot neglect the distribution of random 
variations below zero. If Spearman wishes his i? to be considered always positive, 
then he ought to have found the probable error on the assumption that 5(vi — v,) 
should never be greater than ^ (iV*— l). He has taken a quantity which ranges from 
+ 1 to — '5 and compared its random variations with one which ranges from + 1 
to — 1 for the same frequency. If he had restricted his attention to variations of R 
between and + 1 and of />„ between and + 1 he would not have reached the same 
conclusion. 

But there is a further very serious indictment to be made against Spearman's R. 
For values of N fairly small, which are those for which he proposes to use it, R 
retains a constant value for wide variations in />„. We can show this on an 
exaggerated scale by writing down the possible values for Spearman's R and the true 
rank correlation for 4 individuals taken with random ranks. See Table on p. 23. 

A little consideration will show to what much better results p„ leads us than R. 
R in fact remains constant and = — '2 while p,, passes through the values 0, — % — '4 
and — '6 ; or r can take values from to — '62, while its value as found from R 

* Loc, cU,y footnote, p. 96. 
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remains — 'SS. This simple illustration of how the real rank correlation varies 
widely while Spearman's coeflScient R remains constant shows how unsuitable the 
latter is, when we have to deal with small series. 

Another point worth noting is that, if we take the positive values of the 
correlation only, the mean value of R is "SSI 8, while the mean value of the corre- 
sponding Pm s is '5454 ; the former has a standard deviation of '2622 and the latter 
of '2573, showing that we are not justified in asserting that R has a smaller probable 
error than p„ when we take comparable quantities. 

Spearman appears to have an idea that R is really a coeflScient comparable with 
/),j, and he attempts to get over some diflSculties which have arisen, by telling us to 
reverse one series of ranks when R comes out negative. But reversing the ranks 
does not aid us to the right result. Thus if the ranks in the 12th and 13th column 
of Vj above be reversed, we find that R still remains negative and of the same 
magnitude — '2. In fact it is easy to write down a system of ranks which give a 
negative R, and which on reversal give a negative R six or seven times as big. The 
fact is simply that R is not a symmetrical function of p^ and reversal of ranks does 
not necessarily reverse p,, in sign. 

We see accordingly (i) that the total range of /2 is only about f that of p,„ and 
that if we make the range the same by any attempt to reverse ranks, the Spearman 
method of calculating the probable error for -R = is erroneous, (ii) That the 
distribution of R for random rankings has a median which diflfers from zero, is very 
skew, and is in no ways comparable with that for p^. 

A point to be borne in mind most carefully is that for a given value of R, p„ the 
true rank correlation may take a great variety of values. It is only when (i) the 
number of observations is fairly considerable, and (ii) we assume some distribution of 
associated grades such cus that of normal correlation, that we are able to assert that 
the value of R will fix p„, but such a relationship as that connecting pi„ R and the 
variate correlation r can only be fixed, as in this memoir, by the appeal to despised 
mathematical analysis. 

Thus the advantages claimed by Spearman for R, namely : (a) that it frees the 
discussion from the complexities of mathematical analysis, and (6) that it gives a less 
probable error than more usual ways of approaching the subject, are seen to be 
illusory. 

The diflficulty that p„ may take a whole series of values for a single value of R is 
only surmounted if we define the character of our frequency distribution, and there 
is no doubt that we shall obtain a first approximation by defining it as normal. 
Secondly, we cannot reverse ranks with the eflfect Spearman proposes, and if we could 
his probable error of -R for i2 = would be erroneous. Lastly, if we do not reverse 
ranks, then the probable error of one and the saTue quantity, the variate correlation, is 
considerably greater — for the only case yet worked out — i.e. -R = 0, when found by 
Spearman's method, than when found by the well-known method of squares of 
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differences, and still less than if found by the product of the variates directly. The 
squares of the differences of ranks can be taken so directly and quickly from a table 
of squares, that it does not seem to me that the slight rapidity gained in using positive 
differences of ranks is of any weight against its increased inaccuracy for small series, 
where indeed it is likely to be chiefly used. 

Further no two rank correlations are in the least reliable or comparable unless we 
assume that the frequency distributions are of the same general character (see p. 9), 
and this general character will, till further advance be made in the theory of skew- 
correlation, be undoubtedly that provided by the hypothesis of normal distribution. 
On this assumption Spearman's suggestion of correlation of ranks becomes valid, but 
not as he supposes as a Ding an sich, but only as a means of passing at any rate to 
an approximation to the variate correlation, and this* in the case of quantities where 
it is easier to rank individuals than to measure their attributes accurately. 

For the grounds stated in this section, I propose to use as a rule p^ and not R to 
find r. For this reason I have spent my energies in finding the probable error of p^ 
instead of seeking that of R. 

(8) On the Probable Error of the Correlation of Grades, 

The following investigation is admittedly lengthy, but I have not seen my way to 
shorten it, and the main point is to reach by some road the expression for the probable 
error. The most general expression for the probable error of a correlation whatever 
be the distribution is to be found from '674492^ where* : 

' N[p,,' 2p^p^ 4pJ ij)^ p^,p^ PnpJ 

and P<is = S{n^{x-xY{y-yy}/N (xxix). 

Now in our case x and y are to be the grades g^ and g^ and r is to be 

pu ^Pnl^P^P^. 

which we will write for this investigation p. 
We have at once : 

and : S^, =ifi + 7--- e <^i* dx, 

dg^ = y — e ^i^ dx. 

* Mathematical Contributions to the Theory of Evolution^ xiv. "Draper's Research Memoirs," Biometric 
Series u, p. 20. I have omitted certain terms which cancel. 

4 
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Thus: P'^^NJ (9^''9iT<^9i=o, if m be odd, 

= — — - (iiNO*", if m be even. 
m+1 ^* ^ 

Thus p^ =po4 = ^V-^^ ^"d P*> =i^02 = ^^^ as before (xxx). 

We can now write (xxix) in the form : 

^''=Ffe<^+i^')-2^K + M ^''"'^' 

assuming as we shall show in the sequel (p. 30) that ^,i=p„. Accordingly we have 
now to find p„ and jp„. 

First to find : p^^ ^ {S (g, -^,)' {9,-9,)% 

or if we use the notation of p. 11, 

^""^Nj _« J -CD ^'^^^^^^y (xxxii). 

Now I have not succeeded in integrating this expression, although I have spent 
much time over it, but I have expanded it in powers of the variate correlation r. 

and^j^, andy^- are the same as on p. 15, we can write : 
But* f7=5^t;„M»„e-*^^+y^\ 

where S'w" I 3^^ v„c?x'= I 3^^^' v^n^]/ (xxxiii). 

] -00 J -00 

If n be odd, v^ and w^ have odd powers and g'n = 0, hence p,, contains only even 
powers of r. 

First : g^o = I i.'^ " ^"^ %^^> 

where we may drop the dashes from the letters now, and %= 1. Therefore : 

^-1^'° 1 * ^rZrK = l r y»1 ^— l—y.-i= (xxxiv). 



♦ Pearson: FhU, Trans. A, Vol. 195, p. 3. 
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^_U e-^^ and v =-^ 



Now*: t,,e-i^= -;f-(._e-*-). and v^.^^'/^. 



Hence: . ' ?„= - r"i,*<i(v„.,e-i^)=2 T * /.«-**!;„.,. 

J -00 J -00 

2 f+« _8^ , 4 r+« . _-» , 

= — v„e ' ax-\ — I j-e xv-dx. 

fl/'l) * 

Butt: an?„ = ■«;„+, + ^", thus: 

Or: 9n+. + i^g'« = J ^u„e"5**cfa; = )8„8ay (xxxv). 

It now remains to find ^„. 

Pn = \ w«e" ^"^ dx=\ {^\-i -{n-l) v„J e-5*' dx 

J -00 • J -00 

= _|(n-i)J^%„.,e-5^rfx=-f(n-l)i8,.. 

= (-f)^''(n-l)(n-3)(n-5) 1 X)8,, w being of course even. 

But $0='!*^ %e - 5** f^a; = s/pi 

Thus we have the reduction formula : 

9«^, + ing„ = {-f)*''{n-l)(n-3)(n-5) Ix^f (^^^^)- 

• Zoc. c»<. p. 5. t loe. cit. p. 4. 
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We can now rapidly calculate the g's. 

/2w IT ^t /2w- 5 /2w 

_14 /2^ __1^ /^ _ 2552 /2^ 

^•~ 3 V 3 ' ^•~ 9 V 3 • ^'•~ 27 V 3 • 

This is probably more than sufficient for most practical purposes. Evaluating the 
coefficients numerically we have from (xxxiii) : 

%= 1 + •607.9271r'+ •140,7239r'+ -036,77581^ 

Pit 

+ 0l0,2587r»+'002,9933r'» (xxxvii). 

To test the accuracy of this result— obviously correct for r=0— consider r — 1. 
We have : 

{pjpj)r^t^ 1-798,67 SS (xxxviii). 

But in the case the variate correlation surface becomes a ridge and t, = t„ or : 

1 /■+« N -i — 



"A^J-i^/s*' '"80- 

feL=w=i-« (^--)- 



Thus 

The difference between (xxxviii) and (xxxix) is only '001,3212 or about '07 per 
cent. Thus even if we omit the term in r*®, we shall be less than '2 per cent in error 
in this extreme case, when the probable error itself is zero ; and for lesser values of r, 
where the probable error is sensible, we shall not be as much as '01 per cent in error. 
This is amply suflScient for statistical purposes. I now take p^ and find its value in 
a different manner. 

This can be integrated twice by parts, and the part between limits vanishes at 
each integration. Writing a; = o-, a/, y^o-^yf as before, we have: 



+ 00 

Thus 



/+ao r+oo 

Jjee~'^t>„_,cfe, or 7s = - I ixde"^^ since r^-i = a;. 
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The integration with regard to vf can now be completed and we find : 



-^" = — 7^=- -==^ e *2-r» j*(lx (xl), 



4_r« 

dr (V2fl-)' 
where >,= I e"***rfx, 

and we have dropped the dash on a; as no longer of service. 
Write m = (4 - <■*)/( '2 — r"), and we -must now find : 

/= p" e-^'^^j^Hx (xli) 

Now : 

2m J _„ ^ •'*' 2m 7nJ_„ •" 

- 2m + m(m+l)J_«-^'''^^ ^' 



»+l)i- 



rfm 2m m(m+l)J_oo m(m+ l)V»» + 2' 

thus : T— {yfrnl) = 



dm^ '~ {m + l)-J{m+iy-l' 

Thus: ym/=constant-N/2ff cos-*^^j;:|:Y ^^^"^' 

To evaluate the constant* put m—1, and we have : 
constant = I„,i + •J2ir cos"' ^ 






+ * 1^ / ^ 



■00 



_ iJdL+J2v 



y.'d;y,+y2^^=ir5/y2. 



Orfinally: 7 = ^ {|-cos-.^} 



/2^ . ., 1 



sin"* 



.(xliii). 



Jm m+1 

♦ Mr L. F. Richardson has shown me that if we put m = 0, since the inverse cosine now vanishes: 

_J 
^/2 



constant = Limit <r = oo of ^2^ T" -^ e " * 7^j^*dx, which he has evaluated with the same result. 



80 KARL PEAESON 

Returning now to (xl) we can replace m by its value in terms of r and write 

This expression I have not succeeded in integrating. I have therefore expanded it 
in r* and then integrated. Since p„ = for r = 0, we see the constant is zero after 
integration ; thus after some troublesome expansions I £nd : 

^, = ^{-339,8369r--005,4820r'-'003,6798r'--001,1836r'} (xlv). 

The value of jj^ is clearly the same as p„ for nothing would be altered if x and y 
were interchanged from (xl) onwards. To test the accuracy of the result, suppose 
r= 1. Then we have from the ' ridge ' : 

(l>n)r=i = jv J _ « **' ^' TlW ^~ ***'"* ^* ^^^ *' " *' 
But (xlv) gives us : 



(l^ = 1-8 X 1-00153, 

\i>«7r.i 



that is a result at a maximum only '15 per cent, in error and correct enough for all 
statistical purposes. The next step is to determine the powers of r in terms of />, and 
substitute in the expressions just found for pjp^ and pjpj. I find : 

^^=l + -666,6667/)'+ -108,3084/)*+ •019,7955/)'+-002,7683/)' .(xlvi), 

and: ^, = 1-947,1220/)- -123,4135/)*- •019,4138/)'- -003,8120/)' (xlvii). 

P» 

To verify we note that for p= 1, these give 1*7975 and 1*8005 instead of 1*8, — 

quite sufficiently close for the purpose in view. 

We now substitute in (xxxi) and find as far as p^ that : 

t; = ^il - l-827,5773p» + -688,4587/)*+ •112,7773p*+-020,2900/)4 (xlviii). 

I throw this, by dividing by (1 — p')', into the form : 

V=^^{1 + '086,2113/)'+ -012,9408/)*+ •002,3757/)*+-000,0822/)«y^ 

or, dropping unnecessary decimals : 

Sp^-j^ {l + -086p*+-013p*+-002p'} '. (xlix). 



ON FUKTHEK METHODS OF DETERMINING CORRELATION 3X 

Thus we see that the distribution of grades being very far from noimsJ, the 
probable error •674492p of the correlation of grades exceeds the value •67449(1 — /)')/yi\r, 
which it would take on the hypothesis of normal correlation by a factor which can 
amount to about 10 per cent, at a maximum, but gives per cent, excess when /) = 0, 
then agreeing with our previous result. 

I propose now to find the probable error in r as determined by grade methods in 
terms of r. This involves expressing p and p' in terms of r ; these are easily found 
fix)m the known expansions for sin"^a: and (sin"^a?)'. We have : 

1 +^p»= 1 + •455,9453r»+ -037,9954^*+ -005,0661/^+ -000,81427^, 

2/)= l-909,8593r+ -079,57757^+ •009,2650?-'+ -001,3322^^. 

These must be used in (xxxi), which may be written in the form : 

Hence using (xxxviii) and (xlv), we deduce after some troublesome multiplications : 
2/ = 4-{l - 1 •666,5507r' + -433,6130?^ + -161,83377^ + -049,50427^} 

= -^(1 - r*)*!! + •333,4493r'+ 100,51167^ + -029, 4076r^+ -007,8078/^}. 

IT 

But since : r = 2 sin- p, 

8r=|cos^px8p and 2,. = g v 1 - -Sp. 
Thus: 

V = ^^^^^^'{l + -083,4493r»+ -017,14937^+ -004,27977^+ -000,^^ 

Taking the square root we have : 

2,= 1-0472 —rj^ {1 + -041,7246?^+ "007,70427^+ '001,81847^ + -000,12247^}, . 

or, for all practical purposes, the probable error of r found from the giude correlation 
is, 

p.E. of r= -70633 ^-^{1 + -0427^ + -0087^+ •002?'*} (1). 

Clearly for all values of r, this is larger than the probable error of the correlation 

1 — 7'' * 

T found by the product moment method, i.e. '67449 —txt • The maximum diflference, 

as r approaches unity is 10 per cent. The value can always be found from (1) without 
any trouble. The completer value is singularly close to 

•70633 l-r' ry. 

' JN {1-^r^}* 
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but no advantage is gained in calculation by using this form, as tables of powers of r 
up to the 6th exist*. 

We see therefore from this section that whatever be the value of r, then for 
normal frequency the probable error of r found by the product moment method is less 
than the value found by the correlation of grades. Further there is no reason for 
supposing that the probable error of r found from the difference of grades {R) is not 
greater than the probable error of r found from the product moment of grades. 

We accordingly conclude that the new methods are less accurate than the old. 
But they possess some advantages, — when ranks can be easily determined, — in 
rapidity of calculating, and there are undoubtedly cases where they can be used 
effectively. In saying this I must reassert that I do not believe there is any advantage 
in the knowledge of rank correlation in itself; I look upon it as a mere stage to the 
discovery of the variate correlation. For the comparability of rank correlations 
depends upon the sameness of type in the frequency distributions, and this assumption 
is the weak step in the method. Granted approximately normal distributions, then 
the variate correlation flows from the rank correlation, and the whole investigation 
gains a rich significance. 

My remaining sections will be devoted to illustration of the new methods and 
their comparison with the old. 

(9) Illustration III. Correlation of National Debt and Population. 

The following table is based on data for the year 1900, and raises no pretence to 
exactness, or financial accuracy. It is merely illustrative. 

Table IV. Population and Indebtedness of Various States 1900. 



state 


Population 


Debt in 


Popnlation 


Debt 




('.-'.)» 




in millioDS 


million £ 


Bank 


Bank 


», -r. 


Russia 


129.20 


1097-0 


1 


2 


-1 


1 


United States 


76-40 


200-0 


2 


8 


-6 


36 


German Empire t 


56-34 


649-4 


3 


4 


-1 


1 


Austria 


47-01 


226-7 


4 


7 


-3 


9 


Japan 


43-80 


51-5 


5 


15 


-10 


100 


United Kingdom 


41-60 


705-0 


6 


3 


+ 3 


9 


France 


38-64 


1242-1 


7 


1 


+ 6 


36 


Italy 


32-10 


5000 


8 


5 


+ 3 


9 


Turkey 


20-30 


162-0 


9 


9 








Spain 


1810 


385-0 


10 


6 


+ 4 


16 


Belgium 


6-82 


106-4 


11 


11 








Roumania 


5-50 


58-0 


12 


14 


-2 


4 


Sweden 


5-14 


18-6 


13 


17 


-4 


16 


Holland 


. 5-10 


95-6 


14 


12 


+ 2 


4 


Portugal 


4-70 


155-0 


15 


10 


+ 5 


25 


Argentine 


4-50 


86-4 


16 


13 


+ 3 


9 


Switzerland 


3-30 


3-6 


17 


20 


-3 


9 


Greece 


2-40 


28-0 


18 


16 


+ 2 • 


4 


Norway 


2-20 


12-7 


19 


18 


+ 1 


1 


Denmark 


2-18 


11-6 


20 


19 


+ 1 


1 








— 


— 


30 = ^(v,-v,) 


290 = ;S{v,-v,)» 



See Biometrika, Vol. ii. p. 474. 



t Imperial debt and sum of state debts. 
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Hence : iV^'* - 1 = 399, and />„ = 1 - 6 x 290/(20 x 399) = 7820. 

Further : i2= 1 -6 x 30/399 = -5489. 

These values are obtained in a few minutes, if the ranks have once been written 
down. If /)„ only be required, we need not write down the Pi^p^ column at all, the 
squares being placed down straight away from the rank columns. 

Now applying equations (xxiv) we determine : 

r=7962, found from />„, 

= '7810. found from R. 

The probable error of r found from p^^ as given by Equation (1) is '0596. Thus we 
conclude that 

r = •80± '06, found from p^ 

= -78 ± > '063, found from if*. 
If we turn to the much more laborious method of moments, we find : 

Mean Population =27'26 millions; Mean Debt =289-7 million £, 
S. D. Population =3174 millions; S. D. Debt =357*9 million £. 

Now these results in themselves should be suflScient to warn us that both distri- 
butions are very far from normal ; for the S. D. s in both cases are greater than the 
means, and since in a normal distribution, we might easily have a deviation equal to 
the S. D. we should on that hypothesis expect to get negative debts and negative 
populations. . The distributions are therefore very skew, or in clubbing together great 
and small powers, we have introduced excessive heterogeneity, completely destroying 
any approach to normality t. If we work out the value of r by the product moment 
method, we find : 

r = -68±-08. 

We see at once that the rank method has so exaggerated the correlation that it 
has made the probable error of the less exact methods less than the probable error of 
the more exact method ! The explanation of this lies simply in the fact that the 
system we are dealing with is not normal. If the ranks of two variables were those 
given in Table IV, and the distribution were normal, then the variate correlation 
would be '80 ; it actually takes the value '68, and this is a very good illustration of 
how much the nature of the distribution may affect a judgment from ranks. 

•7738 
♦ The p. e. is of the form — -. — (l'-r*)(l +01^^ + 0,1^ + c^i^), the c's being positive unknown constants, 

and this is > -OGd. 

t If we confine our attention to the seven " great powers," Austria, France, Germany, Great Britain, 
Italy, Russia and the United States, we find pi2 = --143, i? = -*125, giving r = -*15 and -•23 with a 
probable error of '3; this result again emphasises the heterogeneity of the material. 

5 
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Of course it is doubtfiil whether wheft-we are in ignorance of the chai-acter of the 
distribution we could say more than 

r='8±*l, found from p^j, 
and r = 7±'l, found by product-moment. 

These might then be treated as identical for some purposes of inference. But the 
advantage of the longer product-moment method would be that it would have taught 
us that the correlation was non-Gaussian, and given us in the process the regression 
line. This would probably more than compensate for its greater laboriousness. 

(10) Illustration IV. Correlation between mean Size of Litter in a Generation 
and mean Sex Ratio in the same Generation in the case of Mice. 

The following data are taken from a paper in Biometrika, Vol. v., p. 439. 

Table V. 



Generation 


Mean size 
of Litter 


Mean Sex 
Ratio 


Litter 
Bank 


Sex Batio 
Bank 


+ 2 


K-j)* 


Ist 


506 


•505 


5 


3 


4- 


2nd 


4-94 


•491 


6 


4 


+ 2 


4 


3rd 


5-96 


•523 


1 


2 


-1 


1 


' 4th 


593 


•542 


2 


1 


+ 1 


1 


5th 


5-53 


•462 


3 


6 


-3 


9 


1 6t}) 

i 


5-23 


•483 


4 


5 


-1 


1 



Thus: S(i/,-v,)» = 20, 5(v,-v,)=5, 

and p,j=-429, i2=143. 

Whence: r from /)w='45±*23, 

r from i? = -25 ± < '23. 

The actual value of r from product-moment is 

r=-63±-17. 

This example serves to show that the correlation found from R may when the 
observations are few, not be definitely significant, while when we proceed in the more 
accurate manner it is definitely significant. The i2-method is thus shown not to 
have special advantages, but rather peculiar disadvantages for short series. Its merit 
really lies in rapidity of working for assay purposes and rough treatment. 

(11) niustration V. Resemblance of Cousins. 

(a) Width of Hand. The following table gives the width of* the hand in 
34 pairs of male adult cousins taken from my series of Cousin Measurements. These 
data are being used by Miss Ethel M* Elderton in a forthcoming paper on this 
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subject, and I have most heartily to thank her for the exhaustive manner in which 
she has dealt with the material in order to illustrate the whole subject of deter- 
mining correlation by ranks. 



Table VI, Width of Hand in mm. in Pairs of Male Adult Cotisins. 



Ist oooBin X 


3nd consin y 


80-7 


80-0 


90-0 


80-0 


80-7 


84-7 


90-0 


84-7 


80-0 


84-7 


74-5 


810 


810 


80-0 


860 


81-0 


80-7 


83-7 


940 


82-7 


940 


81-7 


760 


77-0 


76-0 


790 


76-0 


830 


86-3 


88-3 


92-5 


85-0 


83-7 


81-7 


83-7 


83-3 


83-7 


78-7 


82-0 


810 


80 5 


800 


75-0 


76-0 


710 


760 


73-0 


77-0 


84-5 


78-0 


760 


78-0 


93-3 


89-7 


93-3 


82-7 


98-7 


82-7 


89-7 


810 


810 


93-3 


82-7 


81-0 


98-7 


81-0 


98-7 


89-7 


Meaii\ 
Size j 


-83-16 



Rank A 



RankB 



23 17 

58 17 

23 48 

58 48 

17 48 

3 26 ! 26 

26 17 j 17 

52 26 I 26 



17 

17 

48 
48 
48 



23 43 

64 37 

64 34 

5 11 

5 16 

5 41 

r3 54 

60 51 
43 34 
43 42 
43 15 

36 26 
22 17 

4 5 

1 5 

2 11 
47 13 

5 13 

61 55 
61 37 
66 37 
55 26 
26 61 

37 26 
66 26 
66 55 



43 
37 
34 
11 
16 
41 
54 
51 
34 
42 
15 
26 
17 
5 
5 
11 
13 
13 
55 
37 
37 
26 
61 
26 
26 
55 



23 
58 
23 
58 
17 
3 

26 

52 

23 

64 

64 

5 

5 

5 

53 

60 

43 

43 

43 

36 

22 

4 

1 

2 

47 

5 

61 

61 

66 

55 

26 

37 

66 

66 




"t-'J 


('.",)' 


6 


36 


41 . 


1681 


-25 


625 


10 


100 


-31 


961 


-23 


529 


9 


81 


26 


676 


-20 


400 


27 


729 


30 


900 


- 6 


36 


-11 


121 


-36 


1296 


- 1 


I 


9 


81 


9 


81 


1 


1 


28 


784 


10 


100 


5 


25 • 


- 1 


1 


- 4 


16 


- 9 


81 


34 


1156 


- 8 


64 


6 


36 


24 


576 


29 


841 


29 


841 


-35 


1225 


11 


121 


40 


1600 


11 


121 


-S(.,-v.) 


S{y,-v,f 


= 605 


= 2x15923 



Trae Grade of A Trae Grade of B 



23-51 

58-82 

23-51 

58-82 

20-74 

5-52 

24-74 

46-00 

23-51 

65-26 

65-26 

8-44 

8-44 

8-44 

47-16 

63-51 

36 36 

30-36 

36-36 

28-95 

22-71 

6-40 

1-70 

3-45 

39-81 

8-44 

64-53 

64-53 

67-58 

5809 

24-74 

31-99 

67-58 

67-58 



•20-74 
20-74 
40-66 
40-66 
40-66 
24-74 
20-74 
24-74 
36-36 
31-99 
27-68 
10-90 
17-08 
33-29 
5416 
41-94 
27-68 
34-62 
16 05 
24-74 
20-74 
8-44 
8-44 
8-44 
13-78 
13-78 
58-09 
31-99 
31-99 
24-74 
64-53 
24-74 
24-74 
5809 



20-74 
20.74 
40-66 
40-66 
40-66 
24-74 
20-74 
24-74 
36-36 
31-99 
27-68 
10-90 
17-08 
33-29 
54-16 
41-94 
27-68 
34-62 
16i»5 
24-74 
20-74 
8-44 
8-44 
8-44 
13-78 
13-78 
58-09 
31-99 
31-99 
24-74 
64-53 
24-74 
24-74 
58-09 



23-51 

58-82 

23-51 

58-82 

20-74 

5-52 

24-74 

46-00 

23-51 

65-26 

65-26 

8-44 

8-44 

8-44 

47-16 

63-51 

36-36 

36-36 

36-36 

28-95 

22-71 

6-40 

1-70 

3-45 

39-81 

8-44 

64-53 

64-53 

67-58 

58-09 

24-74 

31-99 

67-58 

67-58 



The measurements were only read to the millimetre, but since measurements were 
taken two or three times in each case the fractions '3, '5' or 7 arise, when averaging. 
Since either cousin maybe the "first " cousin, we have for a symmetrical table 68 pairs. 
In the third and fourth columns, we have the ranks placed, according as to which 
cousin is considered the " first." It will at once be obvious that many ties arise ; 
thus no less than eight individuals tie with a width of hand 81 mm. at rank 26. It 
is not so clear what rank ought to be given to thenu They run from 26 to 33, 
we may call them all 29*5. We shall speak of this as the mid-rank method. Or, we 
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might put them all at 26, because this would probably be the result nearest to the 
true grade*. We shall speak of this as the bracket-rank method f. 

The above table illustrates the work for the bracket-rank method in columns 
5 and 6, the differences of ranks A and B being, however, only written down once, so 
that to find aS(i/i — i^,), we must sum all quantities in the fifth column as if they had 
the same sign, and double the sum of their squares in the sixth column. 

We find : i2=-2148 and /),,= -3922, 

whence r from /),s==*408± 072, 

r from i2='361± > 072. 

If we now investigate the value of R and /?„ from the mid-ranks, we find that 
5 (v,- 1/,) = 588 and S(v,-v,)" = 29812. Accordingly: 

/2 = '2369, and /)„ = -4310. 
Whence: r from /),3= '448 ± -069, 

r from /2=-396± >'069. 

Both these values for r are higher than those determined by the bracket-rank 
process. We must then question whether the mid-rank or the bracket-rank method 
is the better. Or, indeed is it not possible, that sometimes the one, and sometimes 
the other will be the closer according to the nature of the frequency distribution ? 

To illustrate this point the actual grades on the basis of normal distribution have 
been calculated by Eqn. (xii). It must be remembered that '5 has to be added to 
the grade to obtain the rank, Eqn. (xiii). 

We find : Mean width of hand =83*16 mm. 

Standard Deviation = 6*201 mm. 

As illustration of the method consider the hand of width 84*7 mm., its deviation 
is 1*54 and the ratio of this to the S. D. = '248, this corresponds to a value of ^ (1 -h a), 
in the notation of Sheppard's Tables, ='59793 and multiplied by 68 gives the grade 
40*66, corresponding to a rank 41*16, as against the observed rank 48 or a mid-rank 
49 1 Thus the actual size of organ corresponding to a bracket rank may differ widely 
from the size really belonging to the ranked organ, or the true grade in a general 
population differ very considerably from the spurious grade or rank in the sample 
used. This point again indicates how little can be judged from ranks unless we 
associate the rank distribution with some frequency hypothesis. 

Having found the true grades we may correlate them together to find p^, but in 
using the formula 

* That is, find <r, and calculate g^ and g^ from Eqn. (xii) p. 10 ; the true grade in this case is 24*74, and 
vj = ^1 + -5 = 25*24 is even below 26, not above it. 

t To adopt a term from the examination world, where the place number of the bracket is measured 
only by those above. 
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we may adopt either the theoretical value ^N^ for <r/, or we can actually calculate 
its value. Now ■^N^ = SS5^ and o"/ = 365*94, and thus there is a very considerable 
deviation from normality in the series* 5 (5^,-^3)^ = 31 153' 195, and thus: 

Pi2 found from the true 0-/= '3740, 

/),, found from 0-^' = ^^^ ='4055. 

Whence: r from true o-/=-3890, 

r from <r/ = 33^ = -4215. 

If we might judge from this single case we should conclude that the bracket-rank 
method gave a closer result to the gi-ade method than the mid-rank method. But the 
question now arises, how close after all are all these grade rank methods to the corre- 
lation coefficient in any short series such as the present 1 

Accordingly the series was worked out by product moment and the result obtained 
was 

r = -331 ±"073. 

Thus we see that the actual correlation is considerably lower than that given 
by any of the rank or grade processes. It is perfectly true that '33 and '45 are 
within double the probable error, and therefore two different, random samples of the 
real population might have given as widely divergent results. But this is really the 
case of two different methods applied to the same sample. And further the actual 
correlation tells us that as far as this sample is concerned the true answer is likely to 
lie between '19 and '48, but the mid-rank method tells us that it is likely to lie 
between '31 and '581. Now it is clear we might for isome extraneous reason hold the 
value likely to be '56, and we should find nothing to contradict this in the mid-rank 
result. But the proper method of determining r would show us that such a value 
was itself very unlikely. Thus the latter method when it diverges less than twice 
the probable error from the result of the rank method may yet forbid us to interpret 
the results in a manner admissible on the rank method. We cannot argue in like 
manner from the grade or rank result because that method has assumed an hypothesis, 
not made in the product-moment treatment, i.e. that of normal correlation, which is 
here not justified by the results. 

But even the amount of agreement here noted is to be considered rather excep- 
tional. I owe to Miss Elderton the working out of three other pairs of characters in 
the same set of male cousins each in five different ways. I have myself done each 
of them in three more ways, namely by Variate Differences as in Art. 2, and by the R 
method. The results are given in the Table below. 

* The mean grade in fact =32*41 and not 34 also. 

t Taking a range of twice the probable error on either side the means. 
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Table VII. Comparison of Correlation Coefficients found by Various Methods. 
Resemblance of Hand in 68 Pairs of Male Cousins. 



Character 


Prodact 
Moment 


Variate 
Difference 

•37 
•25 
•14 
•26 


Or 
True V 


ades 



•42 
•22 
■13 
•30 


Bracket-B 

•41 + -01 
•07 + -085 
•21 + -08 
■20 + •OS 


Banks 


1 

1 


ank 
By il 

•36 
•05 

; ^29 

•19 

1 


Mid-Bank { 

1 


By ft, 

•45 + 01 
•08 -I- ^085 
•19±^085 
•24 + -08 


ByJl 

•40 
•03 
•29 
•21 

•23 


Width of Hand 
Width of Wrist 
Length of Index Finger 
Length of Little Finger 

1 


•33 +-07 
•17 + -08 
•l§+-08 
•29f075 


•39 
•12 
•IC 

•18 


Mean of Four Results 

■ 


•25 


•25 
•053 


•21 
•069 


•25 


•22 
•079 


•22 


24 


Root Mean Square Deviation 
from true r 


•060 


•094 


•079 


•096 



It will, I think, be clear from this table that for series even with as many as 
68 pairs — and this is approaching the limit at which any time is gained by using 
rank methods — we cannot hope to ascertain the correlation of the sample by such 
methods within about '1 of its value, and as the probable error of the sample may be 
•07, we may well deviate '2 from the population value in our estimate. We are 
accordingly very unlikely to reach reliable results by rank methods for the 8 to 1 
observations to which Dr Spearman proposes to apply his -B-method. We see that 
the mean values are fairly close, although the variate difference and the second grade 
methods give the best results. Judged by mean square deviations from product 
moment results, the variate difference is easily first, then come the laborious grade 
methods, the rank methods by /)u about fifty per cent, worse than the variate 
difference, and lastly the R methods not quite 100 per cent, worse. Thus we note 
that when a series is not fairly long and not approximately normal, the different rank 
and grade methods will give very diverse results. But when a series is fairly long, 
say 100 or more observations, then there is no advantage in rapidity from the rank 
method ; the formation of a grouped correlation table, and the use of the product 
moment is just as rapid, and further conveys a great deal more of valuable information. 

(12) Conclusions. Three new methods of determining variate correlation have 
been given in this paper. The first, that of variate differences, seems likely to be of 
some service in the case of symmetrical tables containing large numbers, the frequency 
being approximately normal, homotyposis tables may be taken as illustration. 

The second that of deducing variate correlation from correlation of ranks, may be 
of seivice when it is not possible to put a quantitative value on the individual 
character. Thus it might be easy to form a relative series of intensity of pigment, 
and place individuals in rank. But mere correlation of ranks is not in itself a com- 
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parable character, as the variate correlation may have widely different values for the 
same ranking. Justification for the comparability depends upon assuming a wide 
spread rule of frequency distribution, and this rule can hardly be other than normality. 
The present paper shows how to deduce variate correlation from correlation of ranks. 
It shows, however, that such a method of reaching variate correlation is considerably 
less exact than the usual product-moment method. There is no gain in accuracy, but 
the reverse in using such a method in the case of short series. 

Thirdly, the method proposed by Spearman of deducing the correlation of ranks 
from the positive differences of ranks is discussed, and the error of the process by 
which he has deduced for it an accuracy greater than that of the more usual methods 
of finding correlation is indicated. A method for deducing variate correlation from 
positive difference of ranks is indicated. The method is very rapid for short series, 
say those not exceeding 20 observations, but it is less accurate than the product- 
moment method, and considerable changes in the final value reached will be found to 
arise according as we use bracket-ranks or mid-ranks in the case of ties. The 
comparison with true grades for a few special cases, does not enable us to say which 
is the better method ; the deviations from normality sometimes appear to make one, 
sometimes the other, the closer to the true correlation. 

In conclusion, I think, we may say that variate correlation found by ranks may 
prove to be a useful auxiliary method of dealing with correlation, when it is needftil 
to give a rough answer to a problem in a brief time, or when the material itself is 
incapable of being accurately measured. In all such cases mean square of rank 
differences will be more accurate than mean positive rank difference. But both 
methods must be used with caution, and their easy application must not lead us to 
approve exaggerated statements as to their accuracy. 
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